Mixup-Inf-Net: A data augmentation algorithm for segmentation of new coronary pneumonia infections

In 2020, the global spread of Coronavirus Disease 2019 exposed entire world to a severe health crisis. This has limited fast and accurate screening of suspected cases due to equipment shortages and and harsh testing environments. The current diagnosis of suspected cases has benefited greatly from the use of radiographic brain imaging, also including X-ray and scintigraphy, as a crucial addition to screening tests for new coronary pneumonia disease. However, it is impractical to gather enormous volumes of data quickly, which makes it difficult for depth models to be trained. To solve these problems, we obtained a new dataset by data augmentation Mixup method for the used chest CT slices. It uses lung infection segmentation (Inf-Net [1]) in a deep network and adds a learning framework with semi-supervised to form a Mixup-Inf-Net semi-supervised learning framework model to identify COVID-19 infection area from chest CT slices. The system depends primarily on unlabeled data and merely a minimal amount of annotated data is required;therefore, the unlabeled data generated by Mixup provides good assistance. Our framework can be used to improve improve learning and performance. The SemiSeg dataset and the actual 3D CT images that we produced are used in a variety of tests, and the analysis shows that Mixup-Inf-Net semi-supervised outperforms most SOTA segmentation models learning framework model in this study, which also enhances segmentation performance. © 2023 SPIE.

Semi-Supervised Modified-UNet for Lung Infection Image Segmentation

Automatic lung infection segmentation in computed tomography (CT) scans can offer great assistance in radiological diagnosis by improving accuracy and reducing time required for diagnosis. The biggest challenges for deep learning (DL) models in segmenting infection region are the high variances in infection characteristics, fuzzy boundaries between infected and normal tissues, and the troubles in getting large number of annotated data for training. To resolve such issues, we propose a Modified U-Net (Mod-UNet) model with minor architectural changes and significant modifications in the training process of vanilla 2D UNet. As part of these modifications, we updated the loss function, optimization function, and regularization methods, added a learning rate scheduler and applied advanced data augmentation techniques. Segmentation results on two Covid-19 Lung CT segmentation datasets show that the performance of Mod-UNet is considerably better than the baseline U-Net. Furthermore, to mitigate the issue of lack of annotated data, the Mod-UNet is used in a semi-supervised framework (Semi-Mod-UNet) which works on a random sampling approach to progressively enlarge the training dataset from a large pool of unannotated CT slices. Exhaustive experiments on the two Covid-19 CT segmentation datasets and on a real lung CT volume show that the Mod-UNet and Semi-Mod-UNet significantly outperform other state-of-theart approaches in automated lung infection segmentation. IEEE

DBF-Net: a semi-supervised dual-task balanced fusion network for segmenting infected regions from lung CT images.

Accurate segmentation of infected regions in lung computed tomography (CT) images is essential to improve the timeliness and effectiveness of treatment for coronavirus disease 2019 (COVID-19). However, the main difficulties in developing of lung lesion segmentation in COVID-19 are still the fuzzy boundary of the lung-infected region, the low contrast between the infected region and the normal trend region, and the difficulty in obtaining labeled data. To this end, we propose a novel dual-task consistent network framework that uses multiple inputs to continuously learn and extract lung infection region features, which is used to generate reliable label images (pseudo-labels) and expand the dataset. Specifically, we periodically feed multiple sets of raw and data-enhanced images into two trunk branches of the network; the characteristics of the lung infection region are extracted by a lightweight double convolution (LDC) module and fusiform equilibrium fusion pyramid (FEFP) convolution in the backbone. According to the learned features, the infected regions are segmented, and pseudo-labels are made based on the semi-supervised learning strategy, which effectively alleviates the semi-supervised problem of unlabeled data. Our proposed semi-supervised dual-task balanced fusion network (DBF-Net) creates pseudo-labels on the COVID-SemiSeg dataset and the COVID-19 CT segmentation dataset. Furthermore, we perform lung infection segmentation on the DBF-Net model, with a segmentation sensitivity of 70.6% and specificity of 92.8%. The results of the investigation indicate that the proposed network greatly enhances the segmentation ability of COVID-19 infection.

Computer-Aided System for COVID-19 Using Semi-supervised-based Ensemble Learning and Reinforcement Learning

Coronavirus Disease 2019(COVID-19) has shocked the world with its rapid spread and enormous threat to life and has continued up to the present. In this paper, a computer-aided system is proposed to detect infections and predict the disease progression of COVID-19. A high-quality CT scan database labeled with time-stamps and clinicopathologic variables is constructed to provide data support. To our knowledge, it is the only database with time relevance in the community. An object detection model is then trained to annotate infected regions. Using those regions, we detect the infections using a model with semi-supervised-based ensemble learning and predict the disease progression depending on reinforcement learning. We achieve an mAP of 0.92 for object detection. The accuracy for detecting infections is 98.46%, with a sensitivity of 97.68%, a specificity of 99.24%, and an AUC of 0.987. Significantly, the accuracy of predicting disease progression is 90.32% according to the timeline. It is a state-of-the-art result and can be used for clinical usage. © 2022 IEEE.

Fraud Detection Model Using Semi-supervised Learning

Everything is moving to online platforms in this digital age. The frauds connected to this are likewise rising quickly. After COVID, the amount of fraudulent transactions increased, making this a very essential area of research. This study intends to develop a fraud detection model using machine learning's semi-supervised approach. It combines supervised and unsupervised learning methods and is far more practical than the other two. A bank fraud detection model utilizing the Laplacian model of semi-supervised learning is created. To determine the optimal model, the parameters were adjusted over a wide range of values. This model's strength is that it can handle a big volume of unlabeled data with ease. © 2023, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

Identifying Similar Questions in the Medical Domain Using a Fine-tuned Siamese-BERT Model

A large number of people search about their health related problems on the web. However, the number of sites with qualified and verified people answering their queries is quite low in comparison to the number of questions being put up. The rate of queries being searched on such sites has further increased due to the COVID-19 pandemic. The main reason people find it difficult to find solutions to their queries is due to ineffective identification of semantically similar questions in the medical domain. For most cases, answers to the queries people ask would be present, the only caveat being the question may be present in a different form than the one asked by the particular user. In this research, we propose a Siamese-based BERT model to detect similar questions using a fine-tuning approach. The network is fine-tuned with medical question-answer pairs and then with question-question pairs to get a better question similarity prediction. © 2022 IEEE.

A Semi-Supervised Learning Using Tri-Classifier Model with Voting for COVID-19 Cough Classification

Due to the increasing severity of the COVID-19 pandemic, timely screening and diagnosis of infections are essential. Since cough is a common symptom of COVID-19, an AI-assisted cough classification scheme is designed in this paper to diagnose COVID-19 infection. To reduce the labeling efforts by human experts, a semi-supervised learning with voting scheme using a triple-classifier model is proposed for the COVID-19 cough classification. This work aims to improve the accuracy of the classification. Initially, the data pre-processing scheme is executed by performing data cleaning, resampling, and data enhancement so as to improve the audio quality before training. The pre-training scheme is then performed by using a few numbers of COVID-19 cough data with labeling. Then we modify a well-known self-supervised learning model, SimCLR, to a semi-supervised learning-based SimCLR-like model, which uses three different loss functions to fine-tune three training models for cough classification. Finally, a voting scheme is performed based on the classification results of the three cough classifiers so as to enhance the accuracy of the cough classification for COVID-19. The experiment results illustrate that the proposed scheme can achieve 85% accuracy, which outperforms the existing semi-supervised learning-based classification schemes. [ FROM AUTHOR] Copyright of International Journal of Pattern Recognition & Artificial Intelligence is the property of World Scientific Publishing Company and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full . (Copyright applies to all s.)

Improving Semi-supervised Deep Learning by using Automatic Thresholding to Deal with Out of Distribution Data for COVID-19 Detection using Chest X-ray Images

Semi-supervised learning (SSL) leverages both labeled and unlabeled data for training models when the labeled data is limited and the unlabeled data is vast. Frequently, the unlabeled data is more widely available than the labeled data, hence this data is used to improve the level of generalization of a model when the labeled data is scarce. However, in real-world settings unlabeled data might depict a different distribution than the labeled dataset distribution. This is known as distribution mismatch. Such problem generally occurs when the source of unlabeled data is different from the labeled data. For instance, in the medical imaging domain, when training a COVID-19 detector using chest X-ray images, different unlabeled datasets sampled from different hospitals might be used. In this work, we propose an automatic thresholding method to filter out-of-distribution data in the unlabeled dataset. We use the Mahalanobis distance between the labeled and unlabeled datasets using the feature space built by a pre-trained Image-net Feature Extractor (FE) to score each unlabeled observation. We test two simple automatic thresholding methods in the context of training a COVID-19 detector using chest X-ray images. The tested methods provide an automatic manner to define what unlabeled data to preserve when training a semi-supervised deep learning architecture. © 2022 IEEE.

A Review of Deep Learning Imaging Diagnostic Methods for COVID-19

COVID-19 (coronavirus disease 2019) is a new viral infection disease that is widely spread worldwide. Deep learning plays an important role in COVID-19 images diagnosis. This paper reviews the recent progress of deep learning in COVID-19 images applications from five aspects;Firstly, 33 COVID-19 datasets and data enhancement methods are introduced;Secondly, COVID-19 classification methods based on supervised learning are summarized from four aspects of VGG, ResNet, DenseNet and Lightweight Networks. The COVID-19 segmentation methods based on supervised learning are summarized from four aspects of attention mechanism, multiscale mechanism, residual connectivity mechanism, and dense connectivity mechanism;Thirdly, the application of deep learning in semi-supervised COVID-19 images diagnosis in terms of consistency regularization methods and self-training methods. Fourthly, the application of deep learning in unsupervised COVID-19 diagnosis in terms of autoencoder methods and unsupervised generative adversarial methods. Moreover, the challenges and future work of COVID-19 images diagnostic methods in the field of deep learning are summarized. This paper reviews the latest research status of COVID-19 images diagnosis in deep learning, which is of positive significance to the detection of COVID-19. © 2023 by the authors.

Aggregate Learning for Mixed Frequency Data

Large and acute economic shocks such as the 2007-2009 financial crisis and the current COVID-19 infections rapidly change the economic environment. In such a situation, real-time analysis of regional heterogeneity of economic conditions using alternative data is essential. We take advantage of spatio-temporal granularity of alternative data and propose a Mixed-Frequency Aggregate Learning (MF-AGL) model that predicts economic indicators for the smaller areas in real-time. We apply the model for the real-world problem;prediction of the number of job applicants which is closely related to the unemployment rates. We find that the proposed model predicts (i) the regional heterogeneity of the labor market condition and (ii) the rapidly changing economic status. The model can be applied to various tasks, especially economic analysis. © 2022 IEEE.

An Extensive Study on HAR Systems to Recognize Daily Activities using Deep Learning Approaches

"Human Activity Recognition" (HAR) refers to the ability to recognise human physical movements using wearable devices or IoT sensors. In this epidemic, the majority of patients, particularly the elderly and those who are extremely ill, are placedin isolation units. Because of the quick development of COVID, it's tough for caregivers or others to keepan eye on them when they're in the same room. People are fitted with wearable gadgets to monitor them and take required precautions, and IoT-based video capturing equipment is installed in the isolation ward. The existing systems are designed to record and categorise six common actions, including walking, jogging, going upstairs, downstairs, sitting, and standing, using multi-class classification algorithms. This paper discussed the advantages and limitations associated with developing the model using deep learning approaches on the live streaming data through sensors using different publicly available datasets. © 2022 IEEE

FaxMatch: Multi-Curriculum Pseudo-Labeling for semi-supervised medical image classification.

BACKGROUND: Semi-supervised learning (SSL) can effectively use information from unlabeled data to improve model performance, which has great significance in medical imaging tasks. Pseudo-labeling is a classical SSL method that uses a model to predict unlabeled samples and selects the prediction with the highest confidence level as the pseudo-labels and then uses the generated pseudo-labels to train the model. Most of the current pseudo-label-based SSL algorithms use predefined fixed thresholds for all classes to select unlabeled data. PURPOSE: However, data imbalance is a common problem in medical image tasks, where the use of fixed threshold to generate pseudo-labels ignores different classes of learning status and learning difficulties. The aim of this study is to develop an algorithm to solve this problem. METHODS: In this work, we propose Multi-Curriculum Pseudo-Labeling (MCPL), which evaluates the learning status of the model for each class at each epoch and automatically adjusts the thresholds for each class. We apply MCPL to FixMatch and propose a new SSL framework for medical image classification, which we call the improved algorithm FaxMatch. To mitigate the impact of incorrect pseudo-labels on the model, we use label smoothing (LS) strategy to generate soft labels (SL) for pseudo-labels. RESULTS: We have conducted extensive experiments to evaluate our method on two public benchmark medical image classification datasets: the ISIC 2018 skin lesion analysis and COVID-CT datasets. Experimental results show that our method outperforms fully supervised baseline, which uses only labeled data to train the model. Moreover, our method also outperforms other state-of-the-art methods. CONCLUSIONS: We propose MCPL and construct a semi-supervised medical image classification framework to reduce the reliance of the model on a large number of labeled images and reduce the manual workload of labeling medical image data.

Spanish Corpora of tweets about COVID-19 vaccination for automatic stance detection

The paper presents new annotated corpora for performing stance detection on Spanish Twitter data, most notably Health-related tweets. The objectives of this research are threefold: (1) to develop a manually annotated benchmark corpus for emotion recognition taking into account different variants of Spanish in social posts;(2) to evaluate the efficiency of semi-supervised models for extending such corpus with unlabelled posts;and (3) to describe such short text corpora via specialised topic modelling. A corpus of 2,801 tweets about COVID-19 vaccination was annotated by three native speakers to be in favour (904), against (674) or neither (1,223) with a 0.725 Fleiss' kappa score. Results show that the self-training method with SVM base estimator can alleviate annotation work while ensuring high model performance. The self-training model outperformed the other approaches and produced a corpus of 11,204 tweets with a macro averaged f1 score of 0.94. The combination of sentence-level deep learning embeddings and density-based clustering was applied to explore the contents of both corpora. Topic quality was measured in terms of the trustworthiness and the validation index. © 2023 The Author(s)

Spanish Corpora of tweets about COVID-19 Vaccination for Automatic Stance Detection

The paper presents new annotated corpora for performing stance detection on Spanish Twitter data, most notably Health-related tweets. The objectives of this research are threefold: (1) to develop a manually annotated benchmark corpus for emotion recognition taking into account different variants of Spanish in social posts;(2) to evaluate the efficiency of semi-supervised models for extending such corpus with unlabelled posts;and (3) to describe such short text corpora via specialised topic modelling. A corpus of 2,801 tweets about COVID-19 vaccination was annotated by three native speakers to be in favour (904), against (674) or neither (1,223) with a 0.725 Fleiss' kappa score. Results show that the self-training method with SVM base estimator can alleviate annotation work while ensuring high model performance. The self-training model outperformed the other approaches and produced a corpus of 11,204 tweets with a macro averaged f1 score of 0.94. The combination of sentence-level deep learning embeddings and density-based clustering was applied to explore the contents of both corpora. Topic quality was measured in terms of the trustworthiness and the validation index.

Semi-Supervised Multi-View Fusion for Identifying CAP and COVID-19 With Unlabeled CT Images

Recently under the condition of reducing nucleic acid testing for COVID-19 in large population, the computer-aided diagnosis with the chest computed tomography (CT) image has become increasingly important in differential diagnosis of community-acquired pneumonia (CAP) and COVID-19. In prac-tice, there usually exist a mass of unlabeled CT images, especially in regions without adequate medical resources, and the existing diagnosis methods cannot take advantage of the useful information among them. Therefore, it is practical and urgent need to develop a computer-aided diagnosis model that can effectively exploit both labeled and unlabeled samples. To this end, in this paper, we pro -pose a semi-supervised multi-view fusion method for the diagnosis of COVID-19. It explores both the discriminative features from labeled samples and the structure information from unlabeled samples and fuses multi-view features extracted from CT images, including image feature, statistical feature, and lesions specific feature, for improving the diagnostic performance. Specifically, in the proposed model, we utilize semi-supervised learning technique with pairwise constraint regularization to learn the model with both labeled samples and unlabeled samples. Simultaneously, we employ low-rank multi-view constraint to capture latent comple-mentary information among different features from CT images. Experimental results show that the proposed method outperforms the state-of-the-art methods in differential diagnosis of CAP vs. COVID-19.

Named Entity Recognition on CORD-19 Bio-Medical Dataset with Tolerance Rough Sets

Biomedical named entity recognition is becoming increasingly important to biomedical research due to a proliferation of articles and also due to the current pandemic disease. This paper addresses the task of automatically finding and recognizing biomedical entity types related to COVID (e.g., virus, cell, therapeutic) with tolerance rough sets. The task includes i) extracting nouns and their co-occurring contextual patterns from a large BioNER dataset related to COVID-19 and, ii) annotating unlabelled data with a semi-supervised learning algorithm using co-occurence statistics. 465,250 noun phrases and 6,222,196 contextual patterns were extracted from 29,500 articles using natural language text processing methods. Three categories were successfully classified at this time: virus, cell and therapeutic. Early precision@N results demonstrate that our proposed tolerant pattern learner (TPL) is able to constrain concept drift in all 3 categories during the iterative learning process. © 2022, Springer-Verlag GmbH Germany, part of Springer Nature.

Random Forest in Whitelist-Based ATM Security

Accelerated by the COVID-19 pandemic, the trend of highly-sophisticated logical attacks on Automated Teller Machines (ATMs) is ever-increasing nowadays. Due to the nature of attacks, it is common to use zero-day protection for the devices. The most secure solutions available are using whitelist-based policies, which are extremely hard to configure. This article presents the concept of a semi-supervised decision support system based on the Random forest algorithm for generating a whitelist-based security policy using the ATM usage data. The obtained results confirm that the Random forest algorithm is effective in such scenarios and can be used to increase the security of the ATMs. © 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Active deep learning from a noisy teacher for semi-supervised 3D image segmentation: Application to COVID-19 pneumonia infection in CT.

Supervised deep learning has become a standard approach to solving medical image segmentation tasks. However, serious difficulties in attaining pixel-level annotations for sufficiently large volumetric datasets in real-life applications have highlighted the critical need for alternative approaches, such as semi-supervised learning, where model training can leverage small expert-annotated datasets to enable learning from much larger datasets without laborious annotation. Most of the semi-supervised approaches combine expert annotations and machine-generated annotations with equal weights within deep model training, despite the latter annotations being relatively unreliable and likely to affect model optimization negatively. To overcome this, we propose an active learning approach that uses an example re-weighting strategy, where machine-annotated samples are weighted (i) based on the similarity of their gradient directions of descent to those of expert-annotated data, and (ii) based on the gradient magnitude of the last layer of the deep model. Specifically, we present an active learning strategy with a query function that enables the selection of reliable and more informative samples from machine-annotated batch data generated by a noisy teacher. When validated on clinical COVID-19 CT benchmark data, our method improved the performance of pneumonia infection segmentation compared to the state of the art.

A Semi-Supervised Learning Approach for Automatic Detection and Fashion Product Category Prediction with Small Training Dataset Using FC-YOLOv4

Over the past few decades, research on object detection has developed rapidly, one of which can be seen in the fashion industry. Fast and accurate detection of an E-commerce fashion product is crucial to choosing the appropriate category. Nowadays, both new and second-hand clothing is provided by E-commerce sites for purchase. Therefore, when categorizing fashion clothing, it is essential to categorize it precisely, regardless of the cluttered background. We present recently acquired tiny product images with various resolutions, sizes, and positions datasets from the Shopee E-commerce (Thailand) website. This paper also proposes the Fashion Category—You Only Look Once version 4 model called FC-YOLOv4 for detecting multiclass fashion products. We used the semi-supervised learning approach to reduce image labeling time, and the number of resulting images is then increased through image augmentation. This approach results in reasonable Average Precision (AP), Mean Average Precision (mAP), True or False Positive (TP/FP), Recall, Intersection over Union (IoU), and reliable object detection. According to experimental findings, our model increases the mAP by 0.07 percent and 40.2 percent increment compared to the original YOLOv4 and YOLOv3. Experimental findings from our FC-YOLOv4 model demonstrate that it can effectively provide accurate fashion category detection for properly captured and clutter images compared to the YOLOv4 and YOLOv3 models.

Fraunhofer SIT at CheckThat! 2022: Semi-Supervised Ensemble Classification for Detecting Check-Worthy Tweets

During the corona pandemic misinformation has been increasingly spread on social media. Since the automatic verification of social media postings has shown to be challenging, there exists the need of classification systems, that can identify check-worthy posts in social media feeds. In this paper, the classification system used in the CLEF2022-CheckThat! Lab to detect check-worthiness in English tweets is presented. The proposed system, that took advantage of ensemble and semi-supervised learning showed promising results in the experimental evaluation. Further, first experiments were conducted with the novel framework lambeq to solve the classification problem using quantum natural language processing (QNLP), which were not part of the final model. The final model ranked fifth best in terms of the F1-score in the competition. © 2022 Copyright for this paper by its authors.